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Abstract.  Consider! a  statistical  decision  problem  in  which  nature 

—  A 

has  a  finite  number  of  states.  The  elementary  theorems  of  decision 
theory,  namely  the  Mini max  theorem,  the  Complete  class  theorem,  and 
theorems  on  the  structure  of  admissible  rules,  are  proved  in  most 
texts  under  the  assumptions  that  the  risk  set  is  closed  from  below  and 
bounded  from  below  .  The  condition  that  the  risk  set  is  bounded, f rom 
below  is  sufficient  for  the  existence  of  the  lower  boundary  points; 
however,  that  it  is  not  necessary  can  be  seen  from  simple  examples.  The 
purpose  of  this  paper  is  to  extend  the  elementary  theorems  of  decision 
theory  to  include  the  case  in  which  the  risk  set  is  not  bounded  from 

1U  Zutiuir 

below  and  the  set  of  lower  boundary  points  is  nonempty.  -We  also  show! 
that  if  the  risk  set  is  bounded  from  above  then  it  is  necessary  for  the 
risk  set  to  be  bounded  from  below  for  the  set  of  lower  boundary  points 
to  be  nonempty.  We  present  examples > to  illustrate  ear  theorems.  ( 


1 .  Introduction  and  Definitions.  A  statistical  decision  problem 
consists  of  a  triplet  <D,D,R)  where  Q  is  the  set  of  all  possible  states 
of  nature,  also  known  as  the  parameter  space.  The  set  D  is  the  class  of 
all  randomized  decision  rules  available  to  the  statistician.  When  the 
statistician  chooses  the  randomized  decision  rule  6  e  D  and  the  state 
of  nature  is  9  «  Q,  the  risk  of  the  statistician  is  given  by  the  real 
valued  function  R<6,6).  For  a  complete  discussion  of  randomized 
decision  rules,  risk  functions,  the  reader  is  referred  to 
Ferguson (1967)  and  Berger <1985) .  Throughout  this  paper  we  shall 
assume  that  the  parameter  space  Q  is  a  finite  set,  say  C0t  ,d2, . . .  ,9k>  , 


where  k  £  1  is  fixed. 


Given  any  decision  rule  6  *  D,  the  risk  vector  of  6  is  defined 
m  the  vector  x*  (R(61  ,6  ),••••  ,R  (©k  ,6)  )  *•  The  collection 

(1.1)  8  -  |x  «  (R(G1,6)f - ,R<e,,,6)»*  :6  e  oj 

of  all  risk  vectors  is  known  as  the  risk  set.  It  is  well  known  that  Sis 
a  convex  subset  of  /?*;  that  is,  if  x,  y  *  S  and  fS  <  \  £  1  then 
Xx  +  (i-X)y  is  also  in  S.  We  adopt  the  following  definitions  from 
Ferguson (1967) . 

Definition  1.1.  The  subset  S  is  said  to  be  bounded  from  below  if  there 
exists  a  finite  positive  number  A,  such  that  for  every  x  » 
(x  ^  ,  *  .  .  .  ,  x  jj  )  «  S 

(1.2)  x  j  >  A  for  i “1 , - • -  - , k . 

We  say  that  S  is  bounded  from  above  if  for  every  x  »  (xt,.  •  •  •  »*!,>  *  •  S, 

(1.3)  x  j  (  A  for  i*l , . . . . ,k. 

The  set  S  is  said  to  be  bounded  if  it  is  bounded  from  above  and  below. 

Definition  1.2.  Let  x  be  a  point  of  ft* .  The  lower  quantant  at  x,  denoted 
by  Gx,  is  defined  as  the  set 

(1.4)  Qx  ■  (  y  *  (y1,....,yk)  s  y  j  2  x j ,  j*l ,. • • ,k  )• 

In  the  following  definitions  §  denotes  the  closure  of  the  set 


S,  that  is,  5  is  the  smallest  closed  set  containing  S. 


Def ini tion  1 . 3.  A  point  x  is  said  to  be  a  lower  boundary  point  of  a 
convex  set  SC*"  if  QxftS  ■  <x>.  The  set  of  lower  boundary  points  of  a 
convex  set  S  is  denoted  by  LB(S>. 

The  following  lemma  can  be  found  in  Ferguson ( 1967) . 

Lemma  1.4.  Let  S  be  a  convex  subset  of  /?*.  Then  S  is  convex  and  the  set 
of  1  ower  boundary  points  of  S  and  Sis  the  same,  that  is,  LB(S)='LB(S). 

Definition  1.5.  A  convex  set  S  C  .4*  is  said  to  be  closed  from  below  if 
LB (S)  C  S.  We  say  that  S  is  closed  if  S  ■  5. 

Let  x  •  (x1,....,xfc)t  and  y  *  (y1,....,ylt)t  be  two  elements  of 
.  We  write  x  <  y  if  x  t  <  y;  for  i**l , .  .  .  .  ,  k ,  and  x<yifx<y  and 
x^  <  y i  for  atleast  one  j.  The  relations  <  ,  <  induce  a  partial  ordering 
of  the  elements  of  tf*.  The  next  few  definitions  are  concerned  with  the 
class  D  of  randomized  decision  rules  available  to  the  statistician. 

Definition  1.6.  Let  6t  and  &2  be  two  decision  rules  in  D  with  risk 
vectors  xt  and  x2  respectively.  We  say  that  6  t  is  as  good  as  the  rule  &2 
if  Xj  <  x2.  The  rule  &j  is  said  to  be  better  than  62  if  xa  <  x2  and  6j  is 
said  to  be  equivalent  to  62  if  xt  ■  x2. 

Definition  1 . 7.  A  rule  6  is  said  to  be  admissible  if  there  exists  no 
rule  that  is  better  than  &  .  A  rul  e  &  i  s  sai  d  to  be  inadmi  ssibleif  it  is 
not  admissible. 
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It  is  clear  that  inadmissible  rules  are  undesirable.  Thus  in 
looking  -for  a  best  rule,  the  statistician  usually  restricts  his  search 
to  the  class  of  admissible  rules,  provided  the  class  is  nonempty. 

Def  ini  ti  on  1 .  B.  A  class  C  o-f  decision  rules,  CCD,  is  said  to  be 
complete,  i-f  given  any  decision  rule  6  e  D,  not  in  C,  there  exists  a 
rule  s  C  that  is  better  than  6  .  The  class  C  o-f  decision  rules  is  said 
to  be  minimal  complete  if  C  is  complete  and  if  no  proper  subclass  of  C 
is  complete. 


We  note  that  a  complete  class  C  always  exists  for  a 
statistical  decision  problem  (take  C=D>  ,  but  a  minimal  complete  class 
need  not  exist.  However,  if  a  minimal  complete  class  exists  then  it 
consists  exactly  of  the  admissible  rules.  This  result  and  several 
other  results  which  demonstrate  the  relationship  between  minimal 
complete  class  and  admissible  rules  can  be  found  in  Ferguson ( 1967) 
(also  see  Berger  (1983)  ) .  We  state  below  one  important  theorem  that  is 
relevant  to  the  main  theorems  of  this  paper. 

Theorem  1.9.  If  C  is  the  class  of  admissible  rules  and  C  is  a  complete 
class  then  C  is  minimal  complete. 

We  now  proceed  and  develop  the  notion  of  Bayes  rule  and  Bayes 
risk.  Any  probability  distribution  <vt,w3f .  .  .  ,»„)  on  the  parameter 
space  Q  is  known  as  a  prior  distribution.  We  shall  denote  the  class  of 
all  prior  distributions  by  P. 
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Given  any  prior  distribution  w  e  p  and  a  decision  rule  &  6  D, 
the  Bayes  risk  o-f  6  with  respect  to  v  is  defined  as 

<1.5)  BR<*,6)  -  E 

where  Z  is  a  random  variable  having  distribution  ir.  The  Bayes 
principle  requires  the  statistician  to  look  -for  a  rule  which  minimizes 
the  Bayes  risk.  This  rule  if  it  exists  is  known  as  the  Bayes  rule. 
Formally  we  have 

De-f  ini  tion  1.18.  A  decision  rule  is  said  to  be  Bayes  with  respect  to 
the  prior  distribution  ir  «  P  i-f 

<1.6)  BR<*,6{,)  «  inf  BR (t,&) 

66D 

In  searching  -for  a  best  rule  the  statistician  is  also  guided 
by  another  notion  o-f  best  rule,  known  as  the  Mini  max  principle.  A  rule 
is  preferred  to  a  rule  62  i-f 

<1.7)  sup  R<0,st)  <  sup  R<0,62>. 

Be Q  BeQ 

This  relation  "i*  preferred  to”  also  de-fines  a  linear  ordering  on  the 
class  o-f  decision  rules  D.  I-f  the  statistician  decides  to  adopt  the 
Mini  max  principle  then  he  should  look  -for  a  smallest  element  in  this 
ordering.  A  rule  that  is  most  preferred  in  this  ordering  is  called  a 
mini  max  decision  rule.  This  discussion  leads  us  to  the  -following 
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Definition  1.11.  A  decision  rule  6B  is  said  to  be  mini  max  if 

(1.8)  sup  R(0,6„)  *  inf  sup  R(0,&). 

ffsQ  660  06Q 

We  can  also  define  similarly,  a  minimax  rule  for  nature.  This 
will  be  an  element  of  the  class  P.  The  mini  max  rule  of  the  nature  irf  e  p 
is  also  known  as  a  least  favorable  distribution.  The  probability 
distribution  tr#  e  P  satisfies  the  equality 

(1.9)  inf  BR(nf,&)  *  sup  inf  BR(ir,&). 

660  neP  66D 

2.  Main  Theorems.  In  this  section  we  present  the  main  results  of  this 
paper.  The  theorems  presented  in  this  section  are  analogous  to  the 
theorems  in  Chapter  2  of  Ferguson (1967) .  However,  Ferguson ( 1967) 
assumes  that  the  risk  set  S  is  bounded  from  below.  We  replace  this 
condition  by  the  weaker  condition  that  the  set  of  lower  boundary 
points  of  S,  LB(S),  is  nonempty.  We  also  present  applications  of  our 
theorems  which  are  not  covered  by  the  theorems  of  Ferguson  (1967) .  The 
following  lemma  plays  an  important  role  in  the  proofs  of  our  theorems. 


Lemma  2.1.  Let  Cyln,n  >  11,. . ,<yfcn,n  >  11  be  k  sequences  which 

are  bounded  above.  Assume  that  there  exists  j,  1  5  j  <  k,  such  that  yjn 

— — »  —  •  as  n - »  m.  Then  there  exists  an  r ,  1  3  r  3  k,  and  a  subsequence 

{<*>  such  that 


(2.1) 


y.  /  y 

fc  •  r  • 


Ms 


for  all  i,  13  i  3k,  where  0  3  Mj  <  •  and  y  — 


-  •  as  m 


Proof .  We  shall  prove  the  lemma  by  the  method  o-f  induction.  The  lemma 
trivially  holds  -for  k  *  1.  Assume  that  the  lemma  is  true  -for  k  *  (I- 1)  , 
that  is  ,  there  exists  an  r ,  1  <  r  <  (1-1)  ,  and  a  subsequence  {ml  such 
that  <2.  1 )  holds  f or  1  <  i  <  (1-1).  Let  Cy2  m ,  m  >  1 J  be  another  sequence. 
Mote  that 

0  2s  liminf  < vlm  /  yrm  )  <  ■>, 

since  Cv2l|}  is  bounded  above  and  yrm  - >  -*•  as  m - *  «*.  We  consider  the 

-fallowing  two  cases. 

Case  1_:  0  <  limin-f  (ya-  /  yrm  )<».  In  this  case  we  can  -find  a 
subsequence  Cm'}  o-f  Cm}  such  that 

(2.2)  lim  <yJm* /  yrm’  )  *  MJ? 

where  0  <  M2  <  •.  The  subsequence  Cm'}  satisfies  (2.1)  -for  all 
1  <  i  <  I. 

Case  2s  limin-f  (y2-  /y rB)  *  *.  In  this  case  we  can  find  a  sub¬ 

sequence  Cm*}  of  Cm>  such  that 

(2.3)  lim  (yr-#/y2-»)  *  13- 

Combining  (2.3)  with  the  induction  hypothesis  we  get  that  for 

l  <  i  S  (i-1), 

8 


(2.4) 


lim  <yim'/y im*  > 


li<n  (yim*/  yrm 


)  lim  (y. 


/  Yim '> 


*  0  *  H;  (say) . 


rm' 


There-fore  the  subsequence  im'}  and  r  -  1  satisfies  (2.  1)  for  1  <  i  <1. 
This  completes  the  proof  of  Lemma  2.1. 

As  an  application  of  Lemma  2.  1  we  have  the  following  result. 

Lemma  2.2.  Let  S  be  a  convex  subset  of  R* .  Assume  that  S  is  bounded 
above.  If  the  set  of  lower  boundary  points  LB(S)  is  nonempty  then  Sis 
bounded  from  below. 


Proof .  Suppose  S  is  not  bounded  from  below.  Then  there  exists  a 

sequence  yn  *  <y±n*****iyici»>t  6  ®  such  that  yjn  - ►  -  •  for  some  j , 

l<j<k  as  n  - »  •.  Since  the  y-n 's  are  bounded  above,  using  Lemma  2.  1  we 

can  f  ind  an  1<  r  <  k  and  a  subsequence  im}  such  that  yra  - >  -  •  and 

(2.5)  (yiB  t  yrm  )  - *  Mj  as  m  - 

where  0  <  Mi  <  «,  for  1  <  i  <  k.  Let  (z1,....,zk)t  be  an  element  of 
LB(S).  Let  c  >  0  be  given.  Define 

(2.6)  Xa  -  C  (zr-«)  -  yra  3  /  C  zP~yrM  3,  for  mil. 

Note  that  0  <  Xa  <  1  for  sufficiently  large  m.  Since  S  is  convex, 
Xaz  (1-Xa)ya  «  S.  Using  (2.5)  and  (2.6)  we  can  easily  verify  that 

(2.7)  Xa  - »  1 


(2.8) 


+  ( l-X „ ) y 


z  -  e  H 


as  m - *  *,  where  ,*f  =  (M4  ,  .  .  . .  ,Mk  ) t .  Since  Mr  =  l ,  the  limit  point  z  -  e  ft 

,  which  belongs  to  Sf  is  less  than  z  and  this  contradicts  the  fact 
that  z  6  LB(S).  The  proof  of  Lemma  2.2  is  now  complete. 

The  above  lemma  shows  that  if  a  convey,  subset  S  of  /?**  is 
bounded  above,  then  either  S  is  bounded  below  or  LB(S)  is  empty.  The 
following  example  shows  that  we  cannot  relax  the  hypothesis  that  Sis 
bounded  above  in  Lemma  2.2. 

Example  2.3.  Let  k=»2  and  S2=  :  xt  >  — x2>.  In  this  example 

LB(S2)  =  •£  (xt  Tx2)  *  :  -x2>  ,  but  S2  is  neither  bounded  from  above  nor 

bounded  from  below. 

The  converse  of  Lemma  2.2  is  well  known  and  is  stated  in  the 
Lemma  2.4.  The  proof  of  Lemma  2.4  can  be  found  on  page  69, 
Ferguson (1967)  - 

Lemma  2.4.  Let  S  be  a  convex  subset  of  R* .  If  S  is  bounded  from  below, 
then  LB(S)  is  nonempty. 

The  next  lemma  is  crucial  to  the  proofs  of  our  elementary 
theorems  of  decision  theory.  The  proof  follows  easily  from  Lemma  2.2. 


lO 


‘.y:-  r-  vvh  si 1  ^  sin  g*  t  'J'-mi'.i  siv '■:■  ^■.i'V'tm.1’.*.  iv  rur^  *n*.-  t-. 


Lefflffia  2.5.  Let  S  be  a  convex  subset  of  /?*  with  nonempty  lower  boundary 
points  LB(S) .  Let  x  =  (xt ,....  *e  S  and  let  St  =  Qxf>S.  Then  St  is 
bounded  from  below. 

Proof .  Suppose  S4  is  not  bounded  from  below.  Then  we  can  find  a 

sequence  yn  =  (yln,....,ykn)t6S1  such  that  for  some  j  ,  y  j  n  - ♦  —  ®  as 

n  - »  ®.  Let  2  ~  (Z|  j  •  •  .  ,zk  )  *e  LB(S)  .  Since  yn  is  bounded  from  above, 

imitating  the  proof  of  Lemma  2.  2  we  can  find  z '  e  S  such  that  z '  <  z.  This 
contradicts  the  fact  that  z  e  LB<S).  The  proof  of  Lemma  2.5  is 
complete. 


(X1,X2}t  Lemma  2.5  is  best  understood  when  k=2  and  S 
(Zl ,  Z  2)  *  *sa  convex  subset  of  R*.  Let  (x1,x2)ts  S  and 
let  Sj*  QXAS.  Let  <z  t  ,z2>  LB  <S)  .  It  is  easy 

to  verify  that  either  xt  >  ztor  x2  >  z2.  Let 
us  assume  that  x2  >  z2  and  x4  <  zt ,  the  other 
cases  can  be  handled  similarly.  If  St 

is  not  bounded  from  below  then  there  exists  a  sequence  yn  =  (yln  ,y2n )  t|E 

St  such  that  yln  - ♦  -  •  and  z2  <  yan  i  x2.  Since  S  is  convex,  the  line 

Ln  joining  z  and  yn  is  contained  in  la.  Letting  n  converge  to  ®,  we  can 
check  that  Ln  coincides  with  the  line  Y®  z2  (see  Figure  1)  and 
therefore  we  can  find  points  of  5  which  are  less  than  z.  This  is  a 


contradiction  because  z  e  LB(S) 


The  next  theorem  is  the  -first  o-f  our  elementary  theorems  o-f 
decision  theory.  It  is  well  known  that  i-f  the  risk  set  Sis  bounded  -from 
below  and  closed  -from  below  then  the  risk  vector  o-f  every  admissible 
rule  is  contained  in  LB(S).  Theorem  2.6  shows  that  we  can  extend  this 
result  to  the  case  where  the  risk  set  S,  is  not  bounded  below  but  is 
assumed  to  have  nonempty  lower  boundary  points. 

Theorem  2. 6.  Assume  that  the  set  o-f  lower  boundary  points,  LB(S)  ,  o-f 
the  risk  set  Sis  not  empty  and  Sis  closed  -from  below.  Then  a  rule  BSD 
is  admissible  if  and  only  if  the  risk  vector  x-  (x ±  , .  .  .  ,xk )  *  of  6  is 
contained  in  LB<S). 

Proof.  If  x  -  (xlf.  .  .  ,X|,)  *  e  LB<S>  then  it  follows  trivially  that  the 
decision  rule  6  corresponding  to  x  is  admissible.  We  shall  prove  the 
converse  by  the  method  of  contradiction.  Let  6  be  an  admissible  rule 
and  assume  that  the  risk  vector  x  of  6  is  not  in  LB(S) .  Let  St  =  Qxns  •  By 
Lemma  2.5,  the  set  St  is  bounded  from  below.  It  is  easy  to  verify  that 
St  is  convex  and  closed.  Therefore  by  Lemma  2.4,  LB(St)  is  not  empty. 

If  y  e  LB(St)  then 

<2.9>  cy>  -  Qyns1  =  Qyf>Qxn§  =  Qyf>§. 

Thus  y  «  LB(S)  and  since  Sis  closed  from  below,  yes.  Since  y  <  x  ,  Bis 
not  admissible,  which  is  a  contradiction.  This  completes  the  proof  of 


the  theorem 


The  conclusion  of  Theorem  2-6  need  not  be  true  it  we  relax  the 
hypothesis  that  LB(S>  is  nonempty,  as  shown  in  the  next  ex ample. 

Ex  amo  1  e  2.7.  Let  k=2  and  S=  <(x1,xa)t  s  x t >  0,  x2<0}U{(0,0)>.  In  this 
example  we  can  easily  veri-fy  that  S  is  convex  and  LB(S)  is  empty  and 
hence  Sis  closed  from  below.  The  risk  vector  (0,0)  corresponds  to  an 
admissible  rule  but  it  is  not  in  LB(S). 

The  next  theorem  is  the  second  of  our  elementary  theorems  of 
decision  theory.  It  provides  sufficient  conditions  on  the  risk  set  S 
for  the  existence  of  a  minimal  complete  class. 

Theorem  2.8.  Assume  that  the  set  of  lower  boundary  points  LB(S)  of  the 
risk  set  S  is  not  empty  and  S  is  closed  from  below.  Then  the  class  of 
decision  rules 

(2.10)  C={6eDsx“  (R<0ltS>  .....  ,R(«lf,6>)t  «  LB(S>> 

is  a  minimal  complete  class. 

Proof .  It  suffices  to  show  that  C  is  complete,  because  then  we  can 
conclude  that  C  is  minimal  complete  from  Theorem  1.9  and  Theorem  2.6. 
Let  &  be  a  rule  not  in  C,  x  be  the  risk  vector  of  &,  and  S1*»  The  set 

Sx  is  bounded  from  below  by  Lemma  2.5  and  hence  LB(S1)  is  nonempty.  The 
rest  of  the  proof  is  similar  to  the  proof  of  Theorem  2.6.  1  of  Ferguson 
(1967)  and  hence  is  omitted. 


Example  2.9.  Consider  the  risk  set  S-  =  <  (0,0)  )  U  ((x,y)  :  -x— 1  £  y  S  0, 
x  >  0J.  The  convex  set  S3  is  not  closed  -from  below  since  (0,-1)  is  a 
lower  boundary  point  and  it  is  not  contained  in  S3.  It  is  easy  to  veri-fy 
that  the  minimal  complete  class  is  given  by  the  set  of  all  decision 
rules  whose  risk  vectors  belong  to  the  subset  *  C  (0,0)  >  U  -C  <x  ,y)  :  y®» 
— x— 1 ,  x  >  01.  Thus  this  example  shows  that  the  condition  that  the  risk 
set  is  closed  from  below  in  not  necessary  for  the  existence  of  a 
minimal  complete  class. 

One  should  note  that  Theorem  2.6.1  of  Ferguson  (1967)  follows 
from  Lemma  2.4  and  Theorem  2.8.  Combining  Theorem  2.5  and  Theorem  2.8, 
we  have  the  following  corollary. 

Corol 1 arv  2. 10.  Let  C  be  defined  by  (2.10).  Under  the  hypothesis  of 
Theorem  2.8  the  class  of  all  admissible  rules  C  is  minimal  complete. 

As  an  application  of  Theorems  2.6  and  2.8  consioer  the  risk 
set  S2  of  Example  2.3.  The  class  of  all  decision  rules  corresponding  to 
the  points  x  e  LB(S2)  forms  an  admissible,  minimal  complete  class  of 
decision  rules. 

We  now  take  a  look  at  the  question  of  existence  of  Bayes  rules 
in  the  decision  problem  <Q,D,R)  ,  where  8  <■  <8iy... ,8k>.  The  next 
theorem  provides  sufficient  conditions  for  the  existence  of  Bayes 
rules. 


Theorem  2.11.  Let  the  risk  set  S  be  bounded  -from  above.  Assume  that 
LB<S)  is  nonempty  and  S  is  closed  from  below.  Then  -For  every  prior 
distribution  v  «  <v15...,*k)  a  Bayes  rule  with  respect  to  ir  exists. 

Proof .  Under  the  hypothesis  of  the  theorem.  Lemma  2.2  shows  that  Sis 
bounded.  Theorem  2.11  now  follows  from  the  remark  on  page  69  of 
Ferguson  (1967). 

The  next  example  shows  that  we  cannot  relax  the  condition  that 
S  is  bounded  from  above  in  Theorem  2.11. 

Example  2. 12.  Consider  the  risk  set  S2  of  Example  2.3.  Let  the  prior 
distribution  be  (1/4,  3/4).  It  is  easy  to  verify  that  the  Bayes  risk  is 
— «•  and  therefore  a  Bayes  rule  does  not  exist  with  respect  to  the  prior 
distribution  (1/4,  3/4). 

□ur  next  concern  is  to  find  sufficient  conditions  which 
guarantee  the  existence  of  mini  max  strategies  for  both  nature  and  the 
statistician.  The  fundamental  theorem  of  game  theory,  namely  the 
Mini  max  theorem,  states  that  if  the  risk  set  is  closed  and  bounded  from 
below,  then  the  decision  problem  viewed  as  a  two-person  game,  has  a 
value  and  both  the  players  have  mini  max  strategies.  We  show  below  that 
the  Minimax  theorem  holds  under  the  weaker  conditions  that  the  risk 
set  has  nonempty  lower  boundary  points  and  is  closed  from  below. 


Theorem  2.  13.  Mini  max  Theorem.  Consider  the  decision  problem  (Q,D,R>  , 
where  Q  -  <0t, ....  Assume  that  the  lower  boundary  points,  LB(S), 

of  the  risk  set  S  constitute  a  nonempty  set.  Then 

(2.11)  inf  sup  BR(w,6)  *  sup  inf  BR(tt,6)  »  f) 

6eD  ttgP  vgP  6GD 

and  there  exists  a  least  favorable  distribution  w*.  Moreover ,  if  S  is 
closed  from  below,  then  there  exists  an  admissible  minimax  decision 
rule  6e  and  6a  is  Bayes  with  respect  to 

Proof .  Let  1)  —  sup  far  :  QarOS  3  •  },  where  «  a  (a,. ...,«)*.  Since  LB(S>  is 
nonempty,  i)  is  finite.  For  each  n  we  can  find  a  rule  6n  «  D  such  that 

(2.12)  yjn  ■  R(0j,6n)  <  H  +  1/n  for  all  j«l,...,k. 

Let  yn  =  (yln,....  ,'/„„)*.  Clearly  yn  is  bounded  above.  Since  LB (S)  is 
nonempty,  imitating  the  proof  of  Lemma  2.2  we  can  show  that  yn  is 
bounded  from  below.  Let  y  be  the  limit  point  of  y„.  Clearly  y  «  S  and 
Lemma  2.3  shows  that  Qyn§  is  bounded  from  below.  The  rest  of  the  proof 
i  s  si  mi  1  ar  to  the  proof  of  Theorem  2.9. 1  of  Ferguson  ( 1967)  and  hence  is 
omitted. 

Example  2. 14.  Consider  the  risk  set  Sa»f(x1,x2)t  i  x t  >  —  x2>  of 
Example  2.3.  Since  the  risk  set  S2  is  not  bounded  from  below.  Theorem 
2.9.1  of  Ferguson  (1967)  is  not  applicable.  However  Theorem  2.13  is 
applicable  since  S2  actually  has  lower  boundary  points.  In  this 
example  we  can  easily  verify  that  the  value  i)  *0  and  the  least 


•favorable  distribution  vf  »  (1/2,  1/2). 


There  is  an  interesting  relationship  between  admissible 
rules  and  Bayes  rules  when  the  parameter  space  Si  is  finite.  The  theorem 
below  does  not  assume  any  conditions  on  the  risk  set  S.  It  is  an  easy 
consequence  of  the  separating  hyperplane  theorem  (see  page  86, 
Ferguson (1967) ) . 


Theorem  2. 15.  Let  the  parameter  space  Si  be  finite.  If  6  is  an 
admissible  rule,  then  there  exists  a  prior  distribution  v  such  that  6 
is  Bayes  with  respect  to  v. 


Me  are  now  in  a  position  to  state  and  prove  the  fundamental 
theorem  of  decision  theory  under  the  weaker  hypothesis  that  the  risk 
set  has  nonemty  lower  boundary  points. 


Theorem  2. 16.  Complete  Class  Theorem.  Consider  the  decision  problem 
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